CONSTRUCTING ALL SELF-ADJOINT MATRICES WITH 
PRESCRIBED SPECTRUM AND DIAGONAL 
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Abstract. The Schur-Horn Theorem states that there exists a self-adjoint matrix with a given 

spectrum and diagonal if and only if the spectrum majorizes the diagonal. Though the original proof 

of this result was nonconstructive, several constructive proofs have subsequently been found. Most of 

these constructive proofs rely on Givens rotations, and none have been shown to be able to produce 

every example of such a matrix. We introduce a new construction method that is able to do so. 

This method is based on recent advances in finite frame theory which show how to construct frames 

whose frame operator has a given prescribed spectrum and whose vectors have given prescribed 

lengths. This frame construction requires one to find a sequence of eigensteps, that is, a sequence of 

interlacing spectra that satisfy certain trace considerations. In this paper, we show how to explicitly 

construct every such sequence of eigensteps. Here, the key idea is to visualize eigenstep construction 

'"^ as iteratively building a staircase. This visualization leads to an algorithm, dubbed Top Kill, which 

'^ produces a valid sequence of eigensteps whenever it is possible to do so. We then build on Top Kill to 

explicitly parametrize the set of all valid eigensteps. This yields an explicit method for constructing 

^SJ all self-adjoint matrices with a given spectrum and diagonal, and moreover all frames whose frame 

y—{ operator has a given spectrum and whose elements have given lengths. 
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1. Introduction. Given nonincreasing sequences {A„}^^i and {lJ.n}n=i7 con- 
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sider the problem of finding a.n N x N self-adjoint matrix G which has {Xn}n=i a-s 
^ ^^ its spectrum and {iJ,n}n=i ^^ its diagonal entries. The question of whether or not 

such a matrix exists is addressed by the classical Schur-Horn Theorem. To be precise, 
^— I {A„}^=i is said to majorize {/x„}^^i, denoted {A„}^^i h {MnliLi^ if 
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Schur [24] found that the spectrum of a self-adjoint matrix necessarily majorizes its 
diagonal entries. A few decades later, Horn proved the converse [20], yielding: 

Schur-Horn Theorem. There exists a self-adjoint matrix G with spectrum 
5, {Xn}n=i '^'^^ diagonal entries {iJ,n}n=i if <ind only if {y^n}n=i ^ {Mn}^=i- 

5^ Horn's original proof was nonconstructive. In subsequent decades, several con- 

structive proofs were found. In particular, the Chan-Li algorithm [10] conjugates 
a given diagonal matrix by a finite number of Givens rotations so as to produce a 
self-adjoint matrix with a given majorized diagonal. Related algorithms and their 
generalizations are considered in [3, 12, 13]. Such matrices can also be constructed 
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by an optimization-based limiting process [11]. Alternative algebraic proofs of the 
Schur-Horn Theorem are given in [22]. 

In this paper, we provide a new method for constructing Schur-Horn matrices. 
In contrast to previous work, this method constructs all such matrices. This method 
relies on recent developments [5] in the field of finite frame theory. To be precise, the 
synthesis operator of a sequence of vectors F = {fn}n=i i^i '^^ i^ ^ • ^^ ^^ C^ , 
Fg := X]n=i sC"-)/"- That is, F is the M x N matrix whose columns are the /„'s. 
Note we make no notational distinction between a sequence of vectors F — {fn}n=i 
and the synthesis operator F they induce. The vectors F are said to be a frame for 
C^Mf there exists /rame bounds < A<B< oo such that A||/||2 < ||F*/||^ < B\\f\\^ 
for all / e C*^. The optimal frame bounds A and B oi F are the least and greatest 
eigenvalues of the frame operator FF* = '^^=1 fnfni respectively. As such, F is a 
frame if and only if the /„'s span C*^, which necessitates M < N. Broadly speaking, 
finite frame theory is the study of how to construct F so that FF* is well-conditioned 
and so that the /„'s satisfy some additional application-specific, nonlinear constraints. 

In particular, over the past decade, much attention was paid to the problem of 
constructing unit norm tight frames (UNTFs) , namely frames for which FF* = Al 
for some ^ > and for which ||/n|P = 1 for all n. Such frames yield linear encoders 
which are optimally robust with respect to additive noise [17] and erasures [8, 19], 
and are a generalization of the encoders used in CDMA [26, 27]. Unfortunately, 
such frames are also nontrivial to construct. Indeed, prior to [5], only a few explicit 
examples of such frames where known for any given M and N [7, 9, 13, 16], despite the 
fact that the set of all such UNTFs contains manifolds of nontrivial dimension when 
M > A^ -|- 1 [14, 25]. Much of the recent work on UNTFs has focused on the Paulsen 
problem [4, 6], a type of Procrustes problem [18] concerning how a given frame should 
be perturbed in order to make it more like a UNTF. This in turn spurred interest in 
the following problem: 

Problem 1.1. Given any nonnegative nonincreasing sequences {Xm}m=i '^"'^ 
{Hn}n=ir construct all F = {fn}n=i whose frame operator FF* has spectrum {X„i}^^i 
and for which ||/„|P = Hn for all n. 

Note that Problem 1.1 relates to the Schur-Horn Theorem since the Gram matrix 
F*F oi F has diagonal entries {/in}^=i while the spectrum of i^*F is a zero-padded 
version of {Xm}m=i when M < N; this connection is highlighted in [1, 23]. 

In this paper, we build on the main results of [5] to provide a complete construc- 
tive solution to Problem 1.1, and then use that result to construct all Schur-Horn 
matrices. In particular, [5] makes use of an observation, nicely explained in [21], 
that majorization is simply the end result of the repeated application of a more 
basic idea: eigenvalue interlacing. Specifically, a sequence {/3m}m=i interlaces on 
another sequence {am}m=i: denoted {am}m=i E {/^>n}m=ii provided aM < (3m and 
Pm+i < Qfm < Pm for all TO = 1, . . . , M — 1. Interlacing naturally arises in the context 
of frame theory by considering partial sums of the frame operator FF* . In particular, 
for any n = 1, . . . , A^, the frame operator of the M x n synthesis operator Fn of the 
partial sequence of vectors _F„ = {fm}m=i i^ 

n 
Tn=l 

Letting {A„;m}m=i denote the spectrum of F^F^, a classical result [21] implies that 
the spectrum {\n+i-rn}^=i oi F^^-^F*^^ = F,^F*+f^^^f*^;^ interlaces on {\n;ni}^^i- 
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Moreover, if ||/„|| = ^n for all n, then {Xn;m}m=i must also satisfy 



M n n 

J2 K;m = Tr(F„F,:) - Tr(i^,:Fj = ^ ||/„,||2 = ^ ^„. (1.4) 

m—l m— 1 m—1 

In [5], a sequence of interlacing spectra which satisfy the trace conditions (1.4) is 
called a sequence of eigensteps; in this paper, we call them outer eigensteps: 

Definition 1.2. Let {Xm}m=i '^"'^ {fJ-n}n=i ^^ nonnegative and nonincreas- 
ing. A corresponding sequence of outer eigensteps is a sequence of sequences 
{{Xn:m}m=i}n=o "which Satisfies the following four properties: 
(i) Ao:m = for every m — l, ... , M , 

(a) \iq,m = \m for cvcry TO = 1, . . . , M, 

(Hi) {Xn-i-m}m=i E {A„;m}m=i .for cvcry n =: 1, . . . ,iV, 

f^"") Em=i ^n;™ = Em=i Mm for cvcry n^l,...,N. 

In light of the above discussion, any F — {fn}n=i fo'" which FF* has {\m}m=i 
as its spectrum and for which ||/n|P = /in for all n generates a sequence of outer 
eigensteps. The main result of [5] proves that the converse is also true: 

Theorem 1.3 (Theorem 2 of [5]). For any nonnegative nonincreasing sequences 
{Xm}m=i '^''^^ {l^n}n=ir every sequence of vectors F — {fn}n=i ''^ '^'^ whose frame 
operator FF* has spectrum {Xm}m=i '^^'^ which satisfies ||/n|P = /*« for all n can be 
constructed by the following process: 

A. Pick outer eigensteps {{Xn-,m}m=i}n=o '^^ *" Definition 1.2. 

B. For each n — 1, . . . , N , consider the polynomial: 

M 



Pn{x) := ]J (a;- A. 



n:7n f • 



Take any /i G C"'^ such that ||/i|P = /ii. 

For each n — 1, . . . , N — 1, choose any fn+i such that: 

\\Pn;xfn+if - - hm (.T - A)^^^^ VA G {A„.„}^^i. (1.5) 

Here, Pn-.x denotes the orthogonal projection operator onto the eigenspace 
N(AI-F„F,:) of the frame operator (1.3) of F^ := {fm}'^^!- 
The limit in (1.5) necessarily exists and is nonpositive. 
Conversely, any F constructed by this process has {Xm}m=i '^^ ^^^ spectrum of FF* 
ind ||/n|P = /in for all n, and moreover, F^F* has spectrum {Xn;m}m=i- 

We emphasize that Theorem 1.3 is proven from basic principles in [5], the key 
idea being to write Pn+i{x) in terms of p„(a:;), a fact also recently exploited in [2]. 
In particular, the proof of Theorem 1.3 does not rely on the Schur-Horn Theorem. 
We further note that, although Theorem 1.3 provides an answer to Problem 1.1, this 
answer is incomplete. To be clear. Step B involves only standard algebraic techniques, 
and it can be made surprisingly explicit; sec Theorem 7 of [5]. In fact, [15] provides 
MATLAB code to implement Step B. Step A, on the other hand, is vague: for a given 
{Xm}m=i ^'^d {lJ-n}n=i it is uuclcar how to construct a single valid sequence of outer 
eigensteps, much less find them all. The techniques of this paper will make Step A 
explicit, with our main result being: 

Theorem 1.4. Let {Xm}m=i and {lJ.n}n=i ^e nonnegative and nonincreasing 
where M < N . There exists a sequence of vectors F = {fn}n=i ^'^ '^^ whose frame 
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operator FF* has spectrum {Xm}m=i '^^^ f'^^ which ||/n|P = /^n for all n if and only 
»/{A™}^=iU{0}^^^+i > {Mn}^=i- Moreover, ^f {\m}'^U^{Q}':^=M+i ^ {A^n}^=i, 
then every such F can be constructed by the following process: 

A. Let {\N;m}m=l '■— {^m}m=l- 

For n — N, . . . ,2, construct {Xn-i;m}m=i in terms of {\n:m}m=i '^^ follows: 
For each k — M, . . . , 1, if k > n — 1, take Xn-i-k '■= 0- 
Otherwise, pick any Xn-i-k G [^ri-i;fe) -Bn-i;fe]> where 

f M M N 

An-l;k '■= max < Xn:k+1, 2_^ ^n:m — 2_^ ^n-l;rn ^ M" p 
ni—k m—k-\-l 

f , n-1 k M x ,. 

^n-i:fc := niin < A„.fc min -^ 2_^ t^m — 2^ A„.„ — 2^ A„_i.m>>. 

^ ~ '"■' ^ m=l m=l + l m=k+l ^ ^ 



Here, we use the convention that A„;m+i ~ 0, and that sums over empty sets 

of indices are zero. 
B. Follow Step B of Theorem 1.3. 
Conversely, any F constructed by this process has {Xm}m=i '^•^ ^^^ spectrum of FF* 
and ||/n|P = Mn for oil n, and moreover, F^F* has spectrum {Xn;m}m=i- 

In the next section, we discuss how solving Problem 1.1 via Theorem 1.4 suffices 
to construct all Schur-Horn matrices. We also introduce an alternative notion of 
eigensteps: whereas outer eigensteps give the spectra of the partial frame operators 
Fj^F*, inner eigensteps will give the spectra of the partial Gram matrices F^F^. It 
turns out that this second notion of eigensteps simplifies the needed analysis. In 
Section 3, we then visualize the inner eigenstep construction problem in terms of 
iteratively building a staircase. This visualization suggests a new algorithm, dubbed 
Top Kill, which produces a valid sequence of eigensteps whenever it is possible to do 
so. In the fourth section, wc further exploit the intuition behind Top Kill to find an 
explicit parametrization of the set of all valid inner eigensteps, leading to a proof of 
Theorem 1.4 and thus an explicit construction of all Schur-Horn matrices. 

2. Preliminaries. In this section, we further detail the connection between the 
Schur-Horn Theorem and Problem 1.1, and then we reformulate Step A of Theorem 1.3 
in terms of an alternative but equivalent notion of eigensteps, dubbed inner eigensteps. 
With regards to the first point, this connection stems from letting the Schur-Horn 
matrix G be the Gram matrix F*F of the sequence of vectors F — {fn}n=i- 

To be precise, given nonnegative nonincreasing sequences {Xm}m=i ^'^d {l^n}n=i 
where M < N, the Schur-Horn Theorem implies that Problem 1.1 is feasible if and 
only if {nn}n=i is majorized by {Xm}m=i padded with N — M zeros. Indeed, if 
Problem 1.1 has a solution F, then G ~ F*F has spectrum {X,n}m=i U {0}m=M+i 
and diagonal {n„}n=i, and so {fin}n=i ^ {>^ni}m=i U {0}^=m+i by the Schur-Horn 
Theorem. Conversely, if {nn}n=i — {^rn}m=i U {0}m=M-i-i; then the corresponding 
Schur-Horn matrix G can be unitarily diagonalized: 



G ^ VDV* = [Vi ¥2] 



Di 




y; 

v^ 



V,D,V*, 



where Di is an MxM diagonal matrix with diagonal {Xm}m=iJ the matrix F = D^ Vi 
is then one solution to Problem 1.1. This line of reasoning is well-known [1, 13]. 

In this paper, we follow an alternative approach that is modeled on that of [21]: 
rather than use the Schur-Horn Theorem to determine the feasibility of Problem 1.1, 
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we instead independently find all solutions to Problem 1.1, see Theorem 1.4, and then 
use these matrices to construct all Schur-Horn matrices. To be precise, note that 
though the Schur-Horn Theorem applies to all self-adjoint matrices G, it suffices to 
consider the case where G is positive semidefinitc. Indeed, any self-adjoint matrix G 
can be written as G = G + al where G is positive semidefinitc and a < Xmm{G)] 
it is straightforward to show that the spectrum {Xn}n=i of G majorizes its diagonal 
{fi,n}n=i if ^^'^ only if the spectrum {Xn}n=i — {\i ^ ct}n=i of ^ majorizes its 
diagonal {fJ.n}n=i — {An^ct}^=i- Moreover, since G is positive semidefinitc, it 
has a Cholesky factorization G = F*F where F E C^^^. Regarding F as the 
synthesis operator of some sequence of vectors {fn}n=i i^ C^ , we are thus reduced 
to Problem 1.1 in the special case where M — N. Presuming for the moment that 
Theorem 1.4 is true, we summarize the above discussion as follows: 

Theorem 2.1. Given nonincreasing sequences {Xn}n=i '^'^'^ {An}^=i such that 
{■^n}n=i ^ {fi-n}n=ir G'very matrix G with spectrum {Xn}n=i '^''^d diagonal {ij.n}n=i 
can he constructed as G — F* F + al where F is any matrix constructed by taking 
any a < Aniin(G) and applying Theorem 1.4 where A„ := A„ — a and fi„ :=/<„ — a. 
Moreover, any G constructed in this fashion has the desired spectrum and diagonal. 

We are thus reduced to solving Problem 1.1, that is, proving Theorem 1.4; 
this problem is the focus of the remainder of this paper. In light of Theorem 1.3, 
solving Problem 1.1 boils down to finding every valid sequence of outer eigensteps 
{{^n;m}m=i}n=0' ^cc Definition 1.2, for any given nonnegative nonincreasing se- 
quences {Xm}m=i ^-iid {lJ,n}n=i- We now bricfiy summarize an example of such an 
eigenstep characterization problem given in [5]: 

Example 2.2. Consider the problem of constructing all 3 x 5 matrices F with 
unit norm columns such that FF* — |l, namely Problem 1.1 in the special case where 
M = 3, iV = 5, Al = A2 = A3 = I and /ii = /i2 = A*3 = A*4 = Ms = 1- ^"^ [5], it is 
shown that every valid sequence of corresponding outer eigensteps {{Xn:m}m=i}n=o ^-^ 
of the form: 



„;3 u u u X I I 

4 _ 5 5 
3 3 3 

5 5 5 
3 3 3 



A„;3 

A„;2 y 

A„;i 1 2-y 



(2.1) 



where x and y are restricted so as to satisfy the interlacing requirements (Hi) of 
Definition 1.2. Specifically, x and y must satisfy the eleven inequalities: 

{A3,m}m=l C {Xi^rn}m=l "^=^ X<^<^— X<^, 

{A2,™}^=i C {A3,„}i^i ^^ 0<x<2/<|-x<2-y<|, (2.2) 

{Xl,mYm^l^{X2,m?m^l ^^ 0<y<l<2-y, 

which can be simplified to < x < |, max{|, x} < y < min{| + x, ^ — x}. Choosing 
any such {x,y) completes Step A of the algorithm of Theorem 1.3; the corresponding 
eigensteps (2.1) are then used in Step B to produce a 3 x 5 matrix F . For example, 
if {x, y) — (0, g ), one particular implementation of Step B [5] yields the matrix: 

1 







2 

3 


1 
V6 


1 

6 


1 
6 


V5 
3 


V5 
V6 


V5 
6 


V5 
6 








V5 
V6 


V5 
V6 



The previous example highlights the key obstacle in using Theorem 1.3 to solve 
Problem 1.1: finding all valid sequences of cigensteps (2.1) often requires reducing 
a large system of linear inequalities (2.2). In the following sections, we provide an 
efficient method for reducing such systems. It turns out that this method is more 
easily understood in terms of an alternative but equivalent notion of eigensteps. To 
be clear, for any given sequence of outer eigensteps {{^n;m}m=i}n=o^ recall from 
Theorem 1.3 that for any n = 1,...,N, the sequence {Xn;m}m=i i^ ^^e spectrum 
of the M X M frame operator (1.3) of the nth partial sequence F„ — {fm}n=i- In. 
the theory that follows, it is more convenient to instead work with the spectrum 
{^n;m}m=i of the Corresponding nxn Gram matrix F^F^] we use the same notation 
for both spectra since {A„:m}m=i i^ ^ zero-padded version of {\n;m}m=i o^ ^^'^^ versa, 
depending on whether n > M or n < M. We refer to the values {{\n;m}m=i}n=i ^^ 
a sequence of inner eigensteps since they arise from matrices of inner products of the 
/„'s (Gram matrices), whereas outer eigensteps {{\n-^m]m=i}n=o arise from sums of 
outer products of the /„'s (frame operators). To be precise: 

Definition 2.3. Let {\n}n=i '^"■'^ {Mn}ri=i ^^ nonnegative nonincreasing se- 
quences. A corresponding sequence of inner eigensteps is a sequence of sequences 
{{^n;m}m=i}n=i which Satisfies the following three properties: 
(i) ^N;ni = Am for cvcry m^l,...,N, 

(a) {A„_i;m}^"l\ C {Xn-m}m=i foT cvcry u ^ 2, . . . , N , 
(^^'i) Em=i ^ri-m = T,m=i Mm for cvcry n=l,...,N. 

To clarify, unlike the outer eigensteps of Definition 1.2, the interlacing relation 
(ii) here involves two sequences of different length; we write {am}m=\ — {(^m}m=i if 
Pm+i < oim < Pm for all 771 = 1, . . . , n — 1. As the next example illustrates, inner and 
outer eigensteps can be put into correspondence with each other: 

Example 2.4. We revisit Example 2.2. Here, we pad {Am}^^]^ with two zeros 
so as to match the length o/{Mn}^=i- That is, Ai = A2 = A3 = |, A4 = A5 = 0, 
and /^i = /^2 = Ms = M4 = M5 = 1- ^^ fi^^ every sequence of inner eigensteps 
{{Xn:m}m=i}n=i' namely every table of the form: 

n 1 2 3 4 5 



An;5 

A„;4 ? 



A„;3 ? ? I 

A„;2 ? ? ? I 



(2.3) 

A„;l ? ? ? ? I 

that satisfies the interlacing properties (ii) and trace conditions (Hi) of Definition 2.3. 
To he precise, (ii) gives us = A5;5 < A4;4 < A5;4 = and so Xi-i — 0. Similarly, 
3 < A5;3 < A4;2 < A3;i < A4:i < X^-i = | 071(1 so A4;2 = A3;i = A4;i = |, yicMing : 

n 1 2 3 4 5 

An;5 

An;4 (0 A] 

A . 9 ? 5 ^ ■ > 

^n;d • • 3 

A o 9 9 5 5 

A„;2 • • 3 3 

\ , 9 9 5 5 5 

y^n;l • • 3 3 3 



Meanwhile, since ^^ = 1 for all m, the trace conditions (Hi) give that the values in 
the nth column of (2.4) sum to n. Thus, Ai:i — 1 and A4;3 = |; 

n 1 2 3 4 5 



An;5 













A„;4 














An;3 






9 


2 
3 


5 
3 


An;2 




? 


? 


5 
3 


5 
3 


A„:l 


1 


9 


5 
3 


5 
3 


5 
3 



To proceed, we label Aa^s as x and A2;2 as y, at which point (Hi) uniquely determines 
A3;2 and A2:i.- 



1 



An;5 
An;4 
An;3 

An:l 



1 



2-y 



(2.5) 



For our particular choice o/ {A„}^^]^ and {/inj^^i, t/ie above argument shows that 
every corresponding sequence of inner eigensteps is of the form (2.5). Conversely, one 
may immediately verify that any {{A„;m}m=i}^=i of this form satisfies (i) and (Hi) 
of Definition 2.3 and moreover satisfies (ii) when n ~ 5. However, in order to satisfy 
(ii) for n = 2,3,4:, x and y must be chosen so that they satisfy the ten inequalities: 



{'^3,m}m=l !^ {•^4,m}„i=l 
{A2,m}m=i C {\z.m}m=l 
{Al,m}m=l C {A2,m}„^i 



Q<x<l 


<l 


— X 


<i 


x<y< 1 


— X 


< 2 


-y 


y < 1 < 2 


-y- 







(2.6) 



A quick inspection reveals the system (2.6) to be equivalent to the one derived in 
the outer eigenstep formulation (2.2) presented in Example 2.2, which is reducible to 

— x}. Moreover, we see that the outer 

" 5 " 



< X < I, 



max{i a;} < y < niin{| 



eigensteps (2.1) that arise from {Xi, X2, X3} ~ {^, ^, ^} and the inner eigensteps (2.5) 
that arise from {Ai, A2, A3, A4, A5} = {|, |, |, 0, 0} are but zero-padded versions of each 
other; the next result claims that such a result holds in general. 

Theorem 2.5. Let {Xn}n^i and {iJ.n}n=i ^c nonnegative and nonincreasing, 
and choose any M < N such that A„ — for every n > M . Then every choice of 
outer eigensteps (Definition 1.2) corresponds to a unique choice of inner eigensteps 
(Definition 2. 3) and vice versa, the two being zero-padded versions of each other. 

Specifically, a sequence of outer eigensteps {{Xn:m\m=i\n=a gives rise to a se- 
quence of inner eigensteps {{Xn-„i}m=i}n=i' 'where A„.„i := whenever m > M. 
Conversely, a sequence of inner eigensteps {{Xn-m}m=i}n=i gives rise to a sequence 
of outer eigensteps {{Xn;m}m=i}n=o> where Xn-.m '■= whenever m > n. 

Moreover, {Xn-^rn}m=i i^ ^^^ spectrum of the frame operator F^^F^ of Fn = {fm}m=i 
if and only if {Xn:m}m=i i^ ^^^ .spectrum of the Cram matrix F^F^. 

The proof of Theorem 2.5 is straightforward but tedious, and so we do not present 
it here; the interested reader can find it in [15]. In the remainder of this paper, we 
exploit this equivalence to solve Problem 1.1. 



3. Top Kill and the existence of eigensteps. As discussed in the previous 
section, tlie problem of constructing every Schur-Horn matrix boils down to solving 
Problem 1.1, which in light of Theorem 1.3, reduces to the problem of constructing ev- 
ery possible sequence of outer eigensteps (Definition 1.2). Moreover, by Theorem 2.5, 
every sequence of outer eigensteps corresponds to a unique sequence of inner eigensteps 
(Definition 2.3). We now note that if a sequence of inner eigensteps {{Xn;m}m=i}n=i 
exists, then {Xn}n=i necessarily majorizes {fJ.n}n=i- Indeed, letting n = A^ in the 
trace property (iii) of Definition 2.3 immediately gives one of the majorization condi- 
tions (1.2); to obtain the remaining condition (1.1) at a given n = 1,...,A^— 1, note 
that the interlacing property (ii) gives A„;m < ^N-m = Am for all m = 1, ... ,n, at 
which point (iii) implies 



/ ^ f^m — / ^ '^n-m _ / ^ ^n 



m— 1 m— 1 ?n— 1 

[N s_ f,, \N 



In this section, we prove the converse result, namely that if {Xn}n=i ^ {/^n}„=i) 
then a corresponding sequence of inner eigensteps {{Xn;m}m=i}n=i exists. The key 
idea is a new algorithm, dubbed Top Kill, for transforming any sequence {A„;m}m=i 
that majorizes {lJ-m}m=i ™to a new, shorter sequence {Xn;m}^^i that majorizes 
{A^m}m=\ ^^^ ^Iso interlaces with {\n;m}m=i- We note that a similar idea is used 
to prove the Schur-Horn Theorem in [21]; this section's contribution to the existing 
literature is a simple constructive proof to replace the nonconstructive, Intermediate- 
Value- Theorem-based existence proof of Lemma 4.3.28 of [21]. In the next section, 
these new proof techniques lead to a new result which shows how to systematically 
construct every valid sequence of inner eigensteps for a given {Xn}n=i *^d {l^n}n=i- 
We now motivate Top Kill with an example: 

Example 3.1. Let N ^ 3, {Ai,A2,A3} = {l,!,^} and {/xi,/Z2,/X3} = {1,1,1}. 
Since this spectrum majorizes these lengths, we claim that there exists a correspond- 
ing sequence of inner eigensteps {{Xn;m}m=i}n=i- That is, recalling Definition 2.3, 
we claim that it is possible to find values {Ai;i} and {A2;i, A2,2} which satisfy the in- 
terlacing requirements (ii) that {Ai:i} C {A2;i, A2,2} E {f, f, \} as well as the trace 
requirements (iii) that Ai;i — 1 and A2;i + A2;2 = 2. Indeed, every such sequence of 
eigensteps is given by the table: 



1 



1 

ri;3 2 

3 

4 
7 
4 



A 

A„;2 X 

An;l 1 2 



(3.1) 



where x is required to satisfy 

\<x<\<2-x<\, x<l<2-x. (3.2) 

Clearly, any x £ [^, |] will do. However, when N is large, the table analogous to (3.1) 
will contain many more variables, leading to a system of inequalities which is much 
larger and more complicated than (3.2). In such settings, it is not obvious how to 
construct even a single valid sequence of eigensteps. As such, we consider this same 
simple example from a different perspective — one that leads to an eigenstep construc- 
tion algorithm which is easily implementable regardless of the size of N . 




n 1 1 3 1 5 3 7 
'-'424-'-424 

A 

(a) 



g2 





n 1 1 3 1 5 3 7 

"424-'-424 

A 

(c) 




i -, 5 3 7 
[-•-424 


r^ 1 1 3 1 5 3 7 
^424-'-424 


r. 1 1 3 -, 5 3 7 

"424-'-424 


A 


A 


A 


(d) 


(e) 


(f) 



Fig. 3.1. Two attempts at iteratively building a sequence of inner eigensteps for {Ai, A2, A3} = 
{|, |, =} and {/ii, fJ,2, Ms} = {li 1; !}• ^^ detailed in Example 3.1, the first row represents a failed 
attempt in which we greedily complete the first level before focusing on those above it. The failure 
arises from a lack of foresight: the second step does not build sufficient foundation for the third. The 
second row represents a second attempt, one that is successful. There, we begin with the final desired 
staircase and work backwards. That is, we chip away at the three-level staircase (d) to produce a 
two-level one (e), and then chip away at it to produce a one-level one (f). In each step, we remove 
as much as possible from the top level before turning our attention to the lower levels, .subject to 
the interlacing constraints. We refer to this algorithm for iteratively producing {Xn—l;m}^^^i from 
{An;m}JJ,— 1 as Top Kill. Theorem 3.2 shows that Top Kill will always produce a valid sequence of 
eigensteps from any desired spectrum {A„}^_j that majorizes a given desired sequence of lengths 



The key idea is to view the task of constructing eigensteps as iteratively building 
a .staircase in which the nth level is A„ units long. For this example in particular, 
our goal is to build a three-step staircase where the bottom level has length |, the 
second level has length | , and the top level has length | ; the profile of such a stair- 
case is outlined in black in each of the six subfigures of Figure 3.1. The benefit of 
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visualizing eigensteps in this way is that the interlacing and trace conditions become 
intuitive staircase-building rules. Specifically, up until the nth step, we will have built 
a staircase whose levels are {Xn-i;m}^=i- To build on top of this staircase, we use 
n blocks of height 1 whose areas sum to /z„. Each of these n new blocks is added 
to its corresponding level of the current staircase, and is required to rest entirely on 
top of what has been previously built. This requirement corresponds to the interlacing 
condition (ii) of Definition 2.3, while the trace condition (Hi) corresponds to the fact 
that the block areas sum to [in. 

This intuition in mind, we now try to build such a staircase from the ground up. 
In the first step (Figure 3.1(a)), we are required to place a single block of area /ii = 1 
on the first level. The length of this first level is Xi-i — jii. In the second step, 
we build up and out from this initial block, placing two new blocks — one on the first 
level and another on the second — whose total area is 112 = 1- The lengths A2:i and 
•^2;2 of the new first and second levels depends on how these two blocks are chosen. 
In particular, choosing first and second level blocks of area | and \, respectively, 
results in {A2;i, A2;2} = {|, \} (Figure 3.1(b)); this corresponds to a greedy pursuit 
of the final desired spectrum {|, |, i}, fully completing the first level before turning 
our attention to the second. The problem with this greedy approach is that it doesn't 
always work, as this example illustrates. Indeed, in the third and final step, we build 
up and out from the staircase of Figure 3.1(b) by adding three new blocks — one each 
for the first, second and third levels — whose total area is fis = 1. However, in order 
to maintain interlacing, the new top block must rest entirely on the existing second 
level, meaning that its length A3. 3 < A2;2 = t cannot equal the desired value of |. 
That is, because of our poor choice in the second step, the "best" we can now do is 
{A3;i,A3;2,A3;3} = {1,1, 1} (Figure 3.1(c)): 

n 1 2 3 



An:3 
An;2 
An;l 1 



1 
4 

\ 1 

z z 

4 4 



The reason this greedy approach fails is that it doesn't plan ahead. Indeed, it treats the 
bottom levels of the staircase as the priority when, in fact, the opposite is true: the 
top levels are the priority since they require the most foresight. In particular, for X^.^ 
to achieve its desired value of ^ in the third step, one must lay a suitable foundation 
in which A2:2 > 2 in the second step. 

In light of this realization, we make another attempt at building our staircase. 
This time we begin with the final desired spectrum {A3;i, A3;2, As^s} — {|, |, 5} (Fig- 
ure 3.1(d)) and work backwards. From this perspective, our task is now to remove 
three blocks — the entirety of the top level, and portions of the first and second levels — 
whose total area is fi^ = 1. Here, the interlacing requirement translates to only being 
permitted to remove portions of the staircase that were already exposed to the sur- 
face at the end of the previous step. After lopping off the top level, which has area 
A3;3 = ^, we need to decide how to chip away /xi — A3;3 ==1^5 = 5 units of area from 
the first and second levels, subject to this constraint. At this point, we observe that 
in the step that follows, our first task will be to remove the remaining portion of the 
second level. As such, it is to our advantage to remove as much of the second level as 
possible in the current step, and only then turn our attention to the lower levels. That 
is, we follow Thomas Jefferson's adage, "Never put off until tomorrow what you can 
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do today." We dub this approach Top Kill since it "kills" off as much as possible from 
the top portions of the staircase. For this example in particular, interlacing implies 
that we can at most remove a block of area j from the second level, leaving j units of 
area to be removed from the first; the resulting two-level staircase — the darker shade 
in Figure 3.1(e) — has levels of lengths {A2;i, A2:2} = {§, j}- ^" ^^^ second step, we 
then apply this same philosophy, removing the entire second level and a block of area 
1^2 ^^2;2 = 1^ i = i from the first, resulting in the one-level staircase (Figure 3.1(f)) 
in which {Ai^i} = 1. That is, by working backwards we have produced a valid sequence 
of eigensteps: 



Ara;3 






1 

4 


Ara;2 




1 
2 


1 


Ara;l 


1 


3 

2 


7 
4 



The preceding example illustrated a systematic "Top Kill" approach for building 
eigensteps; we now express these ideas more rigorously. As can be seen in the bottom 
row of Figure 3.1, Top Kill generally picks A„_i;m '■= A„;m+i for the larger m's. Top 
Kill also picks Xn-i-m '■= \r.m for the smaller m's. The level that separates the larger 
m's from the smaller ?n's is the lowest level from which a nontrivial area is removed. 
For this level, say level fc, we have Xn-.k+i < fJ'n l£ Xn-k- In the levels above k, we have 
already removed a total of Xn-.k+i units of area, leaving /in — A„;fc+i to be chipped away 
from A„;fc, yielding Xn-i;k '■= Xn;k — (Mm — A„;fe+i). The following theorem confirms 
that Top Kill always produces eigensteps whenever it is possible to do so: 

Theorem 3.2. Suppose {Xn-^rn}m=i ^ {Mm}m=i, and define {A„_i;„}^"l\ ac- 
cording to Top Kill, that is, pick any k such that A„.j.+i < fJ-n l£ Xn-k? and for each 
m = 1, . . . , n — 1, define: 

K:m, 1 < m < fc - 1, 

Xn-l;m '■— ^ A„.fe + A„;fe_|_i — /i„, m = k, (3.3) 

^n:m+i, k+l<m<n — 1. 

Then {A„_i;„}^^\ C {Xn-^j'^^i and {A„_i;„};^~\ >z {ti-mj'^Ji- 

Furthermore, given any nonnegative nonincreasing sequences {Xn}n=i and {lJ.n}n=i 
such that {Xn}n=i ^ {Mn}^=i; define Xn-.tu '■— Xm for every m = 1, . . . ,N, and for 
each n — N, . . . ,2, consecutively define {Xn-i:m}^=i according to Top Kill. Then 
{{Xn:m}m=i}n=i ^^^ inner eigensteps. 

Proof. For the sake of notational simphcity, we denote {0;^}^=^ '= {^n-i;m}^=ti 
and {/?„}"„=! := {Xn.^}"^^-^. Since {I3m}m=i ^ {l^m}'^=i, we necessarily have that 
Pn < Mn ^ Ml ^ i^ij ^nd so there exists fc = 1, . . . , n — 1 such that l3k+i < fJ^n l£ l^k- 
Though this fc may not be unique when subsequent /?„ 's are equal, a quick inspection 
reveals that any appropriate choice of fc will yield the same am's, and so Top Kill is 
well-defined. To prove {am}m^\ ^ {/3m}m=ii we need to show that 

Pm+l <am< Pm (3.4) 

for every m — 1, . . . ,n — 1. If 1 < to < fc — 1, then «,„ :=: /?„, and so the right- 
hand inequality of (3.4) holds with equality, at which point the left-hand inequality 
is immediate. Similarly, iffc + l<?n<n— 1, then a„j := Pm+i, and so (3.4) holds 
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with equality on the left-hand side. Lastly ii m = k, then at '■— Pk + /3fc+i — fJ-n, and 
our assumption that Pk+i l£ l^n l£ l^k gives (3.4) in this case: 

/3fe+l < Pk + Pk+l — A*ri < Pk- 

Thus, Top Kill produces {Q;m}m^\ such that {Q;m}m^\ ^ {Pm\m=i- We next show 
that {am}'^2i ^ {Mm}m=\- If i < fc - 1, then since {I3m}m=i ^ {^^m}m=l^ we have 

J J 3 

m— 1 m—1 m—1 

On the other hand, if j > fc, we have 

j fe-i i j+i 

^ a„ = ^ /3m + (/3fc + /3fc+i - Mn) + X! ''^™+i = X! '^'" ^ '^"' (^-^^ 

m—1 m—1 m— /c+1 tm— 1 

with the understanding that a sum over an empty set of indices is zero. We continue 
(3.5) by using the facts that {/3m}m=i ^ {Mm}m=i and ^j+i > ^„: 

m—1 m—1 m—1 m—1 

Note that when j = n, the inequalities in (3.6) become equalities, giving the final 
trace condition. 

For the final conclusion, note that one application of Top Kill transforms a se- 
quence {A„;m}m=i that majorizes {/im}m=i into a shorter sequence {A„_i:m}m^i 
that interlaces with {A„;m}m=i and majorizes {A*m}m^i- As such, one may indeed 
start with XN;m '■= Am and apply Top Kill A^ — 1 times to produce a sequence 
{{A„:m}m=i}^=i that immediately satisfies Definition 2.3. D 

4. Parametrizing eigensteps. In the previous section, we discussed Top Kill, 
an algorithm designed to construct a sequence of inner eigensteps from given non- 
negative nonincreasing sequences {Xn}n=i and {Hn}n=i- In this section, we use the 
intuition underlying Top Kill to find a systematic method for producing all such eigen- 
steps. To be precise, treating the values {{A„;m}m=i}n^/ ^^ independent variables, 
it is not difficult to show that the set of all inner eigensteps for a given {Xn}n=i 
and {iJ-n}n=i form a convex polytope in M^(^^i)/2. Our goal is to find a useful, 
implementable parametrization of this polytope. 

We begin by noting that this polytope is nonempty precisely when {Xn}n=i nra- 
jorizes {fJ.n}n=i- Indeed, as noted at the beginning of the previous section, if such 
a sequence of eigensteps exists, then we necessarily have that {A„}^^]^ >: {l^n}n=i- 
Conversely, if {Xn}n=i ^ {l^n}n=i, then Theorem 3.2 states that Top Kill will pro- 
duce a vahd sequence of eigensteps from {A„}^^j and {^„}^^i. Note this imphes 
that for a given {A„}^^]^ and {/in}^=i, if any given strategy for building eigensteps is 
successful, then Top Kill will also succeed. In this sense, Top Kill is an optimal strat- 
egy. However, Top Kill alone will not suffice to parametrize our polytope, since for a 
given feasible {Xn}n=i and {fJ.n}n=iJ it only produces a single sequence of eigensteps 
when, in fact, there may be infinitely many such sequences. In the work that follows, 
we view these non-Top-Kill-produced eigensteps as the result of applying suboptimal 
generalizations of Top Kill to {A„}^^2^ and {i^n}n=i- 
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For example, if {Ai, A2, A3, A4, A5} — {|, |, |, 0, 0} and /i„ = 1 for all n = 1, . . . , 5, 
every sequence of inner eigensteps corresponds to a choice of the unknown values 
in (2.3) which satisfies the interlacing and trace conditions (ii) and (iii) of Defini- 
tion 2.3. There are 10 unknows in (2.3), and the set of all such eigensteps is a convex 
polytope in M^*^. Though this dimension can be reduced by exploiting the interlacing 
and trace conditions — the 10 unknowns in (2.3) can be reduced to the two unknowns 
in (2.5) — this approach to constructing all eigensteps nevertheless requires one to 
simplify large systems of coupled inequalities, such as (2.6). 

We suggest a different method for parametrizing this polytope: to systematically 
pick the values {{Xn;m}m=i}n=i 011^ s-t a time. Top Kill is one way to do this: 
working from the top levels down, we chip away /i5 = 1 units of area from {Xz-m}m=i 
to successively produce A4;4 = 0, A4;3 = |, A4;2 = | and A4.1 = |; we then repeat this 
process to transform {X4-^m}m=i i'^to {X3.^rn}m=i^ ^^'-^ ^'^ on; the specific values can 
be obtained by letting {x,y) = (0, |) in (2.5). We seek to generalize Top Kill to find 
all ways of picking the A„;m's one at a time. As in Top Kill, we work backwards: we 
first find all possibilities for A4;4, then the possibilities for A4;3 in terms of our choice 
of A4:4, then the possibilities for A4:2 in terms of our choices of A4:4 and A4:3, and so 
on. That is, we iteratively parametrize our convex polytope in the following order: 

^4:4j '^4;3i ^4;2, A4;i, A3;3, A3. 2, A3.1, A2;2, ^2;!, Ai-i. 

More generally, for any {Xn}n=i and {m«}^=i such that {Xn}n=i ^ (A^nl^^i 
we construct every possible sequence of eigensteps {{Xn\m}m=i}n=i by finding all 
possibilities for any given Xn-i-M in terms of A„':m where either n' > n—1 or n' = n — 1 
and m > k. Certainly, any permissible choice for Xn-i;k must satisfy the interlacing 
criteria (ii) of Definition 2.3, and so we have bounds A„;fe+i < A„_i;fe < A„;fc. Other 
necessary bounds arise from the majorization conditions. Indeed, in order to have 
both {Xn-m}'^=i ^ {Mm}™=i and {A„_i;„}^"l\ > {lJ.m}'^2i we need 



M« 



n 

> >m^ 
m=l 


n-1 
m— 1 


n 

- > ; An. 

m=l 



XI ^ri-l-m, (4.1) 



and so we may view /i„ as the total change between the eigenstep spectra. Having 
already selected A„_i:„_i, . . . , A„_i:fc+i, we've already imposed a certain amount of 
change between the spectra, and so we are limited in how much we can change the 
fcth eigenvalue. Continuing (4.1), this fact can be expressed as 

n—1 n—1 

ra—\ m—k 

where the inequality follows from the fact that the summands A„;„i ~ A„_i;m are 
nonnegative if {A„_i;„}^^\ is to be chosen so that {A„_i;„}^^\ C {Xn-m}m=i- 
Rearranging (4.2) then gives a second lower bound on Xn-i.k to go along with our 
previously mentioned requirement that Xn-i-k > -^n;A;+i: 

n n — 1 

An-1;A; > 2_^ Xn-m — / ^ Xn-l-m ~ Mn- (4-3) 

m^k m—k-\-l 

We next apply the intuition behind Top Kill to obtain other upper bounds on 
'^n-i:*; to go aloug with our previously mentioned requirement that Xn-i-k < Xn-k- 
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We caution that what foUows is not a rigorous argument for the remaining upper 
bound on Xn^i-kj but rather an informal derivation of this bound's expression; the 
legitimacy of this derivation is formally confirmed in the proof of Theorem 4.1. Recall 
that at this point in the narrative, we have already selected {Xn-i;m}^^k+i ^^'^ ^^^ 
attempting to find all possible choices Xn-i;k that will allow the remaining values 
{Xn-i;m}m=i ^o bc choscu in such a way that: 

{Xn~l;m}m=l ^ {Xn;m}m=l^ {^«-l:m}"i=i h {Mm}m=i- (4.4) 

To do this, we recall our staircase-building intuition from the previous section: if it 
is possible to build a given staircase, then one way to do this is to assign maximal 
priority to the highest levels, as these are the most difficult to build. As such, for 
a given choice of Xn-i-.k, if it is possible to choose {A„_i;m}j„'Lj^ in such a way that 
(4.4) holds, then it is reasonable to expect that one way of doing this is to pick 
Xn-i-k-i by chipping away as much as possible from Xn-k-i, then pick Xn-i-k-2 by 
chipping away as much as possible from Xn-k-2, and so on. That is, we pick some 
arbitrary value A„_i;fc, and to test its legitimacy, we apply the Top Kill algorithm to 
construct the remaining undetermined values {Xn~i;m}m=i', we then check whether 
or not {A„_i.„};;;i\ h {Aim}™=\. 

To be precise, note that prior to applying Top Kill, the remaining spectrum is 
{Xn:m}m=i, and that the total amount we will chip away from this spectrum is 

f n-i ^ 

Mn ^ I A„;„ + y ^ (Xn-m ^ Xn-l;m) I • (4-5) 

m—k 

To ensure that our choice of A„_i;fe_i satisfies Xn-i-k-i > A„;fe, we artificially rein- 
troduce A„;fe to both (4.5) and the remaining spectrum {A„;m}mLi before applying 
Top Kill. That is, we apply Top KiU to {13^}^,^, := {A„;„}£^i U {Oj'^^k+i^ where 

/ n—l \ n n—1 

A* := /^n^ I A„.„+ ^^ (A„;,„— A„_i;m) 1 +A„.fe = /i„— y ^ A„;m+ ^^ A„_i;m- (4.6) 
m—k m—k+1 m—k 

Specifically in light of Theorem 3.2, in order to optimally subtract fi units of area 
from {/3m}m=ii '^6 first pick j such that /3j+i < ^ < (3j. We then use (3.3) to produce 
a zero-padded version of the remaining new spectrum {Xn-i-m}m=ti U {0}m=fe' 

Xn-m, 1 < "1 < j - 1, 

n n—l 

'^n—l:m ^ \ t^'ij ' '^n:j-\-l Mn ' / ^ ^n\n\' / ^ ^n—l-.m'i ^^ 3 

m'— /c+1 m' — k 

Xn-m+l, j + l<m<k-l. 

Picking I such that j + 1 < I < k, we now sum the above values of Xn-i-m to obtain 
i-i j-i i-i 

/ ^ ^n — \\m / ^ ^n — \\m i -^n—l-.j i / ^ ^n — l;?n 

rri— 1 m—1 m—j-\-l 

I n n—l 

— / ^ Xn-m — /in + / ^ Xn-m ~ / ^ Xn-l-^m- (4-7) 

?n— 1 n'L—k-\-l m—k 
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Adding >, Mm — 2_j ^n-.m = to the right-hand side of (4.7) then yields 



rM— 1 m— 1 

/—I / n n— 1 n n 

/ ^ '^n — l;m — / ^ -^n^ni /^n r / ^ ^n;m / ^ '^n— l;m ^" / ^ Mm / ^ '^n;??! 

?n— 1 m— 1 m— /i;+l m—k m—1 ni—1 

n— 1 A; n — 1 

= / ^ Mm ^ / ^ ^n;m ^ / ^ -^ri-l;m- (4-8) 

m=l m=i + l m=fc 

Now, in order for {A„_i;m}m=\ ^ {lJ'm}^Ji as desired, (4.8) must satisfy 

/ ^ Mm _ / ^ '^n— l;m / ^ f^jn / ^ ^n;m / ^ ^n— l;m- \^*^/ 

m—1 m—1 m—1 m—l + 1 m—k 

Solving for Xn-i-k in (4.9) then gives 

n— 1 fc n— 1 

Ari-l;fc < 2_^ 1^"^ ^ Z_^ Xn:m — 2_^ Xn-l:m.- (4-10) 

TM— ^ m— /+1 m— fc+1 

Note that, according to how we derived it, (4.10) is valid when j + 1 < I < k. As 
established in the following theorem, this bound actually holds when I = l,...,fc. 
Overall, the interlacing conditions, (4.3), and (4.10) are precisely the bounds that we 
verify in the following result: 

Theorem 4.1. Suppose {\n■m}m^l>{^Jim}m^l■ Then {\n-i-m}'^2i '^ {l^m}'^2i 
and {A„_i;„}^^\ C {A„;,„}^^i if and only if \n-i-k G [An-i-k,Bn-i-k] for every 
k = 1 n— 1, where 



f n n — 1 

An-l;k := max < A„;fe+i, 2_^ Xn;m — 2_^ A„_i;^ 
7n—k m—k-\-l 



n-1 

m4' (4.11) 

r r n—\ k n— 1 N N 

5n-i;fe := min j A„;fe, _min < '^ fJ-m - ^ K:rn - ^ A„_i;„ ^ L (4.12) 

^ ~ '■"' ^ m=l m=l+l rn=k+l ^ ^ 

Here, we use the convention that sums over empty sets of indices are zero. Moreover, 
suppose A„_i;„_i, . . . , A„_i;fe_|_i are consecutively chosen to satisy these hounds. Then 
An~i:k < Bn-i-k, and so Xn-i;k Can also be chosen from such an interval. 

Proof For the sake of notational simplicity, we let {am}^'l\ ■— {A„-i;m}"jl\, 

{Pm}m=l •= {Ara;m}m=l, ^fe := ^n-l;fc, and Bfe := Bn-l-k- 

(^) Suppose {a™}^^\ > {tXm}l^2i and {a^}'^2i ^ {^m};^=i. Fix any par- 
ticular k ~ l,...,n— 1. Note that interlacing gives Pk+i < ctk < Pki which ac- 
counts for the first entries in (4.11) and (4.12). We first show ak > Ak. Since 
{Pm}m=i ^ {Mm}™=i and {a™};^-\ h {Mm};^=\, then 

n n — 1 n n—l n — 1 

M« = X! *"" ~ X! ^™ ^^ l^m-^am^ I3n+^ {l3m - "m)- (4-13) 

m—1 m—1 m—1 m—1 m—1 

Since {ctmjm^i E {/^mjm^i' ^^^ suiiiniands in (4.13) arc nonnegative, and so 

n—1 n n—1 

Mn > /3n + ^ (/3m " Ctm) ^ '^ Pra - ^ Q:„ - Qffc. (4-14) 

m^k m—k m— fc+1 
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Isolating ak in (4.14) and combining with the fact that ak > /3fc+i gives a^ > Ak- 
We next show that a^. < B^. Fix I = 1, . . . , fc. Then {am}J^'L\ >: {M)n}m^\ iniphes 
m=i "m > Z^„=i Mm and 2^,„^i a„i = Z^„=i Mm^ and so subtracting gives 

n — 1 n— 1 n— 1 /c— 1 n— 1 /c— 1 

^ Mm > ^ am = X! "™ + X! "™ - X! "™ + X! ^n^+l' (4-15) 

'tn—l m—l m^k m—l m—k m—l 

where the second inequality follows from {amlm^i !^ {f3,n}m=i- Since our choice for 
I — 1, . . . , fc was arbitrary, isolating aj. in (4.15) and combining with the fact that 
ttfe < /3fe gives ak< Bk. 

(<^) Now suppose Ak < afc < Bk for every k ~ 1, ... ,n — 1. Then the first 
entries in (4.11) and (4.12) give (3k+i < otk < /3k for every fc = 1, . . . ,n — 1, that is, 
{am}m=\ E {/3m}m=i- It remains to be shown that {ajnj'^n^i h {Mm}^=\- Since 
ttfc < Bk for every fc = l,...,n— 1, then 

n— 1 k n—1 

afc<^Mm- ^ ;3„ - ^ a,„ Vfc = 1, . . . , n - 1, Z = l,...,fc. (4.16) 

m— / m— / + 1 m— A;+l 

Rearranging (4.16) in the case where / — k gives 

71 — 1 n—1 

^a„,<^^lm Vfc = l,...,n- 1. (4.17) 

'tn—k m^k 

Moreover, ai > Ai implies ai > X]m=i /^m — X]m=2 '^m ^ Mn- Rearranging this 
inequality and applying {Pmjm^^ h {Mm}m=i then gives 

n—1 n n—1 

^ "m > ^ /3m - M« = X! ^™- (4-18) 

m—l m—l m—l 

Combining (4.18) with (4.17) in the case where k = 1 gives 

n—1 n—1 

X] "m = XI '^™- ("^-1^) 

m—l m—l 

Subtracting (4.17) from (4.19) completes the proof that {amYmJi — {Mm}"i=\- 

For the final claim, we first show that the claim holds for fc = n — 1, namely that 
A„_i < -B„-i- Explicitly, we need to show that 



f f n—1 n—1 

J < min \ /3„_i, min i Y^ Mm - V" ;3„ 

I / — I .n—1 I ^ — ' ^ — ' 

^ v. ,„^; m=/+l 



max{/3„, /3„_i + /?„ - ^„} < min ■{ /3„_i, _ ^min <{ } ^ fim - ^ ;3„ ^ ^. (4.20) 

=/+i 

Note that (4.20) is equivalent to the following inequalities holding simultaneously: 

(i) Pn <l3n-l, 

(ii) /3„_i + l3n- fJ.n< /3„-l, 

n—1 n—1 

(iii) /3„ < X ^Irn - X /3m V/ = 1, . . . , n - 1, 
m— / m— / + 1 
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(iv) /3„_i + /3n ~ fin < ^ IJ-m - ^ Pm V/ = 1, . . . , n - 1. 

m—l 'm—l-\-l 

First, (i) follows immediately from the fact that {/3m}m=i i^ nonincreasing. Next, 
rearranging (ii) gives /?„ < A^n, which follows from {Pm}m=i ^ {Mm}m=i- For (iii), 
the facts that {l3m}m=i ^ {Mm}m=i and {/im}m=i is nonincreasing imply 



n-l 



y^ I3m < ^ Mm < ^ Mm V^ == 1, . . . , n - 1, 

m—l-\-l m—l-\-l m—l 

which in turn implies (iii). Also for (iv), the facts that {Pm}m=i i^ nonincreasing and 
{/3m}™=i h {Mm}™=i imply 

n n n 

/3„_i + ^ Pm <^ Pm <^ ^^m V^ = 1, . . . , n - 1, 

m— /+1 m— / m— / 

which in turn implies (iv). We now proceed by induction. Assume a^+i satisfies 
Ak+i < Oik+i < Bk+i- Given this assumption, we need to show that Ak < Bk- 
Considering the definitions (4.11) and (4.12) of Ak and Bk, this is equivalent to the 
following inequalities holding simultaneously: 

(i) Pk+i < Pk, 

n n — 1 

(ii) '^Pm- ^ am-fJ-n<f3k, 

m—k m—k-^1 

n—1 k n— 1 

(iii) /3fe+i < ^ /i™ - ^ Pm- ^ am V; = l,...,fc, 

m— / m— / + 1 m— A;+l 

n 71 — 1 n — 1 A; n — 1 

(iv) '^Pm- ^ Ckm - Mn < X] ^"^ ~ X! ''''" ^ X! "™ V/ = l,...,fc. 
m—k m— /c+l m^i r?i— / + 1 m— /c+1 

Again, the fact that {Pm}m=i i^ nonincreasing implies (i). Next, ak+i > ^fc+i gives 

n n—1 

ttfc+l > 2^ ^m - 2^ am~ IJ'n, 
m—k + 1 m—k-\~2 

which is a rearrangement of (ii). Similarly, ak+i < -Bfe+i gives 

n—1 fc+1 n—1 

"fe+l < ^ Mm - ^ ,5„ - ^ Qfm VZ = 1, . . . ,fc + 1, 

m^l m—l + l 'm—k-\-2 

which is a rearrangement of (iii). Note that we don't use the fact that (iii) holds 
when I = k + 1. Finally, (iv) follows from the facts that {Pm}m=i i^ nonincreasing 
and {Pm}m=i ^ {Mm}m=i, sincc they imply 

n n n 

m—l + 1 m—l m— / 

which is a rearrangement of (iv). D 
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We now note that by starting with a sequence {^N;m}m=i — {^m}m=i that ma- 
jorizes a given {Mm}m=i, repeatedly applying Theorem 4.1 to construct {Xn-i;m}]^i 
from {Xn:m}m=i ^csults in a sequence of inner eigensteps that satisfy Definition 2.3. 
Conversely, if {{Xn;m}m=i}n=i is ^ valid sequence of inner eigensteps, then for ev- 
ery n, (ii) gives {A„;m}^'l\ C {Xn;m}m=ii while (ii) and (iii) together imply that 
{Xn;m}m=i ^ {/^m}m=i & !& the discussion at the beginning of Section 3; as such, any 
sequence of inner eigensteps can be constructed by repeatedly applying Theorem 4.1. 
We now summarize these facts: 

Corollary 4.2. Let {Xn}^^i and {lJ,n}n=i ^^ nonnegative and nonincreas- 
ing where {Xn}n=i 'tl {fJ-n}n=i- Every corresponding sequence of inner eigensteps 
{{Xn;m}m=i}n=i '^'^'^ ^^ Constructed by the following algorithm: Let Xjy^m ~ X„i for 
all m = 1,. . . ,N - 1; for any n = N,. . . ,2 construct {A„_i;„}J^'l\ from {Xn;m}m=i 
by picking Xn-i-M e [An-i;k, Bn-i-k] for all k = n-1, . . . ,1, where An-i-k and Bn-i-k 
are given by (4.11) and (4.12), respectively. Moreover, any sequence constructed by 
this algorithm is indeed a corresponding sequence of inner eigensteps. 

We now redo Example 2.4 to illustrate that Corollary 4.2 indeed gives a more 
systematic way of parametrizing the eigensteps: 

Example 4.3. We wish to parametrize the eigensteps corresponding to UNTFs 
of 5 vectors in M.^ . In the end, we will get the same parametrization of eigensteps as 
in Example 2.4-' 

n 1 2 3 4 5 



(4.21) 



A„:5 

















A„;4 


















An;3 








X 




2 
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5 
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A„;2 




y 




4 
3 


- X 


5 
3 


5 
3 


An;l 


1 


2- 


-y 


5 
3 




5 
3 


5 
3 



where Q < x < |, max{|, x} < y < min{| -|- x, | — x}. In what follows, we rederive 
the above table one column at a tim,e, in order from right to left, and filling in each 
column from top to bottom. First, the desired spectrum of the final Gram matrix 
gives us that As^s = A5^4 = and As^s = A5_2 = As^i = |. Next, we wish to find all 

{A4,m}m=l such that {A4,m}^=i E {Xz,raYm=l ^nd {A4,m}^^i > {Mm}m=l- To thlS 

end, taking n = 5 and k = A, Theorem 4-1 gives 
max{A5;5, A5.4 + A5.5 - ,^5} < A4;4 < min <^ A5;4, _min <^ ^ Mm - ^ X^.,.^ > >, 

^ ~ ' "■' *- m=l m=l+l ■' ■' 

= max{0, -1} < A4;4 < min{0, |, |, 2, 1} = 0, 

and so A4;4 = 0. For each k = 3,2,1, the same approach gives A4;3 — |, A4;2 = |, 
and A4;i = |. For the next column, we take n = 4. Starting with k = 3, we have 

max{A4;4, A4;3 + A4:4 - M4} < A3;3 < min <^ A4;3, _min S ^ Mm - ^ A4;™ [ [, 



= max{0, -i} < A3;3 < niin{|, |, |, 1} = ^ 



m=/+l 

3' 3' 3' -^J ^ 3' 
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Notice that the lower and upper bounds on X^-g, are not equal. Since X^-s is our first 
free variable, we parametrize it: A3. 3 — x for some x G [0, |]. Next, k = 2 gives 



7; — X = max{g, 3 — a;} < X^-2 < min{|, ^ — .t, 2 — x} = g 



and so X3-2 ~ ^ ^ ^- Similarly, X^-i = |. Next, we take n = 3 and k = 2: 

niax{x, |} < A2:2 < min{| — x, | + a;, 1}. 
Note that A2;2 is a free variable; we parametrize it as A2:2 = JJ such that 

ye[l,l + x] ifxe [0, i], ye[x,^-x] ifxe [i,|]. 

Finally, A2.1 — 2 — y and Ai 1 == 1. 

We conclude by giving a complete constructive solution to Problem 1.1, that is, 
the problem of constructing every frame of a given spectrum and set of lengths. Recall 
from the introduction that it suffices to prove Theorem 1.4: 

Proof of Theorem I.4: We first show that such an F exists if and only if we have 
{Am}m=i U {0}^^^_^i h {M«}iLi- Though this may be quickly proven using the 
Schur-Horn Theorem — see the discussion at the beginning of Section 2 — it also fol- 
lows from the theory of this paper. In particular, if such an F exists, then Theorem 1.3 
imphes that there exists a sequence of outer eigensteps corresponding to {Xm}m=i ^^'^ 
{fj,n}n=i'j by Theorem 2.5, this implies that there exists a sequence of inner eigensteps 
corresponding to {Xm}m=i ^ {(^}m=M+i ^^'^ {Mn}^=i; by the discussion at the begin- 
ning of Section 3, we necessarily have {Xm}m=i ^ {0}m=M+i — {l^n}n=i- Conversely, 
if {^m}m=i U {0}m=M+i — {l^n}n=n thcu Top Kill (Thcorcm 3.2) constructs a corre- 
sponding sequence of inner eigensteps, and so Theorem 2.5 implies that there exists a 
sequence of outer eigensteps corresponding to {Xm}m=i ^-^id {l^n}n=iJ ^t which point 
Theorem 1.3 implies that such an F exists. 

For the remaining conclusions, note that in light of Theorem 1.3, it suffices to show 
that every valid sequence of outer eigensteps (Definition 1.2) satisfies the bounds of 
Step A of Theorem 1.4, and conversely, that every sequence constructed by Step A 
is a valid sequence of outer eigensteps. Both of these facts follow from the same two 
results. The first is Theorem 2.5, which establishes a correspondence between every 
valid sequence of outer eigensteps for {Xm}m=i ^^'^ {l^n}n=i ^i^h a valid sequence 
of inner eigensteps for {Xm}m=i U {0}m=M+i ^^'^ {l^n}n=i ^^'^ '^ice versa, the two 
being zero-padded versions of each other. The second relevant result is Corollary 4.2, 
which characterizes all such inner eigensteps in terms of the bounds (4.11) and (4.12) 
of Theorem 4.1. In short, the algorithm of Step A is the outer eigenstep version of the 
apphcation of Corollary 4.2 to {Xm}m=i ^ {0}m=M+i' ^^^ ™^y easily verify that all 
discrepancies between the statement of Theorem 1.4 and Corollary 4.2 are the result 
of the zero-padding that occurs in the transition from inner to outer eigensteps. D 
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